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ON  A CLASS  OF  CONCAVE-SEPARABLE  INTEGER  PROGRAMS 


Gary  Kochman 


In  this  paper  we  consider  the  class  of  concave-separable  integer 
programming  problems. 


maximize  f.(x.)  , 

0=1  J J 


subject  to 


Ax  = b 


& < x < u,  x integer 


where  A is  an  m X n unimodular  matrix  (see  Section  l),  b is  an 
m-vector,  i,  u,  and  x = (x  , ...  , x^)  are  n-vectors,  and  each 
f (x.)  is  concave  for  i.  < x.  < u.,  j = 1,  2,  ...  ,n.  Without  loss 

oo  o-o-o 

of  generality,  b,  £,  and  u may  be  taken  to  be  all-integer. 

Practical  interest  in  problems  of  the  type  (S^)  appears  to  have 

originated  with  the  work  of  Schwartz  and  Dym  (1971)*  In  their  model, 

the  f.(x.)  take  the  specific  form 
0 0 

x . 

f.(x.)  = v (1-d  ^),  j = 1,  2,  ...  , n , 

J J J 


where  v > 0 and  0 < d < 1 are  constants.  Furthermore,  the  matrix 
0 

A consists  of  a single  row  with  each  entry  equal  to  one.  Weinstein 
and  Yu  (1973)  have  generalized  the  Schwartz  and  Dym  model  to  include 
problems  in  which  each  objective  function  component  f. (x.)  '“y  be 

any  concave,  nonnegative,  increasing  function.  In  the  present  work, 


1 


the  latter  two  assumptions  are  dropped  as  well 


and  we  further  extend 


the  class  to  include  problems  with  general  unimodular  constraint  matrices 
Other  applications  which  give  rise  to  problems  of  the  form  (S^,) 
have  been  considered  separately  by  Kochman  (1976)  and  McCallum  (197*0. 


Following  a brief  discussion  of  unimodularity  in  Section  1,  a general 


solution  procedure  for  concave-separable  integer  programs  is  developed 


in  Section  2.  The  procedure  is  illustrated  in  Section  3 using  the  models 


discussed  by  McCallum  and  by  Schwartz  and  Dym 


1.  Unimodularity 


To  begin,  a few  concepts  related  to  unimodular  matrices  are  pre 


sented.  The  notation  "det  X"  is  used  to  denote  the  determinant  of  the 


square  matrix  X 


Definition : Let  the  m X n matrix  M have  all-integer  entries  and 


rank  m.  Then  M is  unimodular  if  each  basis  Bw  of 


Theorem  1:  Let  the  m X n matrix  A be  unimodular,  and  denote  the 


columns  of  A by  a . , j = 1,  2 


matrix  A formed  from  A by  appending  columns  a 


where  each  a 


is  identically  equal 


and  K.  is  arbitrary 


but  finite.  Then  A is  also  unimodular 


Proof:  For  each  basis  Be-  of  A 


there  is  a corresponding  identical 


basis  B.  of  A.  That  is,  each  of  the  columns  of  B~  is  identical  to 


one  of  the  columns  of  B. , although  the  order  in  which  the  columns  appear 


The  following  result  due  to  Veinott  and  Dantzig  (1968)  is  included 
for  completeness. 

Theorem  2:  Let  the  m X n matrix  A have  rank  m,  and  let  x(A,b)  = 

{x|ax  = b,  x > O).  Suppose  A has  all-integer  entries. 

Then  the  following  are  equivalent: 

(i)  A is  unimodular; 

(ii)'  The  extreme  points  of  X(A,b)  are  integral  for 
all  integral  b; 

(iii)  Every  basis  has  an  integral  inverse. 

For  our  purposes,  parts  (i)  and  (ii)  of  Theorem  2 are  of  greatest  interest. 
Because  of  their  equivalence,  these  imply  that  when  the  constraint  matrix 
A is  unimodular,  the  linear  program, 

maximize  cx  , 
subject  to 

Ax  = b 
x > 0 , 

* 

has  an  optimal  solution  x which  is  naturally  integral. 

2.  A General  Solution  Procedure 


Returning  now  to  the  problem  (S^,),  consider  the  piecewise  linear 

approximation  to  f.(x.)  which  coincides  with  f.(x  ) at  each  integer 
JO  J J 

point  between  i.  and  u..  (See  Figure  1.)  Call  this  approximation 
J J 

g.(x.).  It  is  easy  to  see  that  g.(x.)  is  concave  whenever  f.(x.) 

J J J J JO 

1/ 

is  concave.— 


Actually,  for  the  results  here,  it  is  not  necessary  that  f^.(x^.) 
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the  piecewise  linear  approximation  to 


Form  of 


Define  problem  (S  ) by 


maximize 


subject  to 


Since  only  integer  solutions 


to  (S-)  are  of  interest,  and  since  g (x  ) differs  from  f.(x.)  only 
at  non-integer  values  of  x.,  it  is  clear  that  (,S  ) and  (S^,)  must  have 
the  same  optimal  solution(s).  Consequently,  (S  ) and  (S„)  are  equivalent 
integer  programs,  and  (S  ) may  be  solved  in  place  of  (S„) . 


be  concave.  It  is  sufficient  that  f.(x.)  "looks"  concave  at  the  integer 

J J , , \ 

points  in  its  domain;  i.e.,  that  the  approximating  function 

(j  = 1,  2,  . . . , n)  is  concave. 


As  indicated  in  Figure  1,  each  variable  x.  can  be  expressed  as 

J 

the  sum  of  (u . - i.)  auxiliary  variables  x , 

JO  JK 

u.-J. 

0 J 

x . = & . + 5)  0 = 2,  ...  , n , (l) 

J J ^ J k 

provided,  of  course,  that  0 < x.,  < 1 (k  = 1,  2,  . . . , u . - i ) , and 

— J*  — J J 

that  no  x > 0 unless  x , = 1.  Each  of  the  auxiliary  variables 
JK  J-K--*- 

x.,  , k = 1.  2,  . . . , u . - l . , is  associated  with  one  of  the  linear 
jk  ' * J J 

segments  of  the  approximating  function  g.(x.),  and  the  integer  restric- 

J J 

tions  on  the  x.  (j  = 1,  2,  ...  , n)  are  recaptured  by  requiring  each 
J 

x.,  to  equal  either  zero  or  one.  Designating  the  slope  of  the  k**1 
JK 

segment  of  g^(x..)  by 

g.(^.+k)  - g ,(i ,+k-l) 

* V+ k)  ■ (Lil-i)  ’ ej<Yk>  - ’ 

J J 


s.,  = f.(i.+k)  - f.(i.+k-l),  for  k = 1,2, . . . ,u . , j 
JKJJ  J J J J 


• >n.  (2) 


T 

J i 


Using  (l),  (2),  g (x.)  be  expressed  as 

J J 

u.-i. 

W ” 8j(V  * V Vjk-  0 ■ 1.  2,  •• 


Thus,  problem  (S  ) may  be  re-written  as 
8 

n u • 

(T)  £ MV  + maX  D ( Z sikxik)  » 

A j J jti  kti 


subject  to 


u ,-i. 
n J J 

Z aM  Z xik}  = V 

jti  kti  Jk  1 


i = 1,  2, 
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0 £ 1 1/  xik  integer,  k = 1,  2,  ...  , u.-l 


jk 


J 3 

j=l,  2,  ...  , n , 


n 

w 


where  b!  = b.  - Y.  and  the  b.  and  a.,  are  the  entries  of 

i i j lj  J i 1.1 


j=l 


1 3 


b and  A,  respectively.  The  adjusted  right-hand  sides  b;, 

i = 1,  2,  ...  , m,  are  integral,  since  each  b.,  a..,  and  i.  are 

l lj  J 

integral. 

Letting  A denote  the  matrix  of  constraint  coefficients  for  (t), 

'V 

it  is  clear  that  the  column  of  A associated  with  each  x., 

jk 

(1  < k < u.  - H .)  is  identical  to  the  corresponding  column  of  A associ- 
J J 

ated  with  x..  That  is,  the  matrix  A is  relat  to  the  matrix  A in 
J 

that  for  each  column  a.  of  A,  there  appear  u.  - l.  identical  columns 

J J J 

in  A.  It  follows  from  Theorem  1 and  the  unimodularity  of  A that  A 

is  unimodular:  Thus,  the  integer  restrictions  on  the  auxiliary  variables 

x.,  may  be  dropped,  and  (T)  may  be  solved  as  a linear  program.  The 
Jk 

unimodularity  of  A and  Theorem  2 assure  that  the  optimal  solution, 

* 

x =x  (1<  k<  u.  - i.,  1 < j < n),  will  be  all-integer.  The 
Jk  Jk  — — J 0 — — 

* / . 

optimal  integer  solution  x to  (S  ) - and  so,  to  the  original  problem 

§ 

(Sj.)  - may  then  be  recovered  by  (l). 

In  practice,  it  is  not  necessary  to  introduce  the  auxiliary  variables 


x explicitly.  From  the  theory  of  concave-separable  linear  programs, 

Jk 

it  is  known  that  no  x.,  will  be  increased  above  zero  unless  x.,  , = 1. 

Ok  jk-1 

Thus,  using  the  revised  simplex  method  (generating  the  columns  of  A 

only  as  needed)  with  the  bounded-variable  technique,  and  setting  markers 

k.,  j = 1,  2,  ...  , n,  to  point  to  the  first  x at  its  lower  bound 

J Jk 

of  zero,  only  x..  and  x.,  . are  candidates  to  enter  the  basis. 

Jk  Jk-1 

J J 

Hence,  only  the  columns  associated  with  x , x . (j  = 1,  2,  ...  , n) 

J J J J 1 
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need  be  priced  out  at  each  iteration.  These  columns  differ  only  in  the 


objective  row,  so  there  is  little  additional  work  in  updating  both  rather 

than  one.  Note  that  the  s may  be  computed  by  (2)  only  as  needed. 

This  can  be  important  computationally  if  the  functions  f.(x.)  are 

J J 

difficult  to  evaluate.  We  illustrate  these  remarks  with  two  simple 
examples  in  the  next  section. 


3.  Examples 

There  are  several  known  applications  which  give  rise  to  concave- 
separable  integer  programs,  and  two  of  these  are  now  discussed  in  more 
detail.  The  first  is  a slight  generalization  of  the  weapons  allocation 
model  of  Schwartz  and  Dym: 


maximize 

5) 

j=i 

v (1-d  J)  , 
J J 

subject  to 

n 

j=l 

x . = M 
J 

x.  > 0,  integer,  for 

The  problem  (b)  is  that  of  allocating  M weapons  to  n 


00 

. . , n . 

targets,  where 


x . 

j 

V . 
0 

d. 

j 


= number  of  weapons  allocated  to  target  j; 

= value  of  destroying  j target  (v.  > 0, 

J 

= probability  that  a weapon  allocated  to  the 

fail  to  destroy  it  (0  < d.  < 1). 

J 


1 < j < n) ; and 
target  will 


Schwartz  and  Dym  developed  a simple  rounding  procedure  by  which 
the  optimal  integer  solution  to  (4)  could  be  obtained  from  the  optimal 


continuous  solution.-  It  is  assumed  that  d.  = d for  all  j,  although 

J 

the  authors  point  out  that,  in  general,  the  true  probabilities  d.  would 

J 

be  different  for  different  j.  The  rounding  procedure  employed,  however, 

is  valid  only  for  the  invariant  case  d.  = d = constant  for  1 < j < n. 

J 

Here,  this  restriction  is  removed. 

It  is  easy  to  verify  that  (4)  belongs  to  the  class  of  problems  repre- 

x . 

sented  by  (Sf).  The  concavity  of  f.(x.)  = v.(l-d.J)  follows  immediately 
* J J J 0 


by  noting  that 


d f . (x  . ) x . 2 

--5-  d- ■■  = -v.d.^ln  d.)  <0,  for  all  x.  . 


Furthermore,  the  "matrix"  of  constraint  coefficients  is  clearly  unimodular 

since  each  constraint  coefficient,  and  therefore  the  determinant  of  each 

basis,  is  identically  equal  to  one. 

In  problem  (4),  there  are  no  explicit  upper  bounds  on  the  x.,  and 

J 

the  lower  bounds  are  H . = 0,  j = 1,  2,  ...  , n.  Thus,  g.(i!.)  = f.(0)  = 
for  j = 1,  2,  ...  , n.  The  associated  linear  program  (t)  in  this  case 


maximize 


subject  to 


n M 

lj  h ’ 

j=l  k=l 


n M 

x>  ii  xjk = M 

j=l  k=l 


f or  j — 1,  2,  ...  , n,  k — 1,  2,  ...  ,M 


— McGill  (1970)  has  since  shown  that  the  Schwartz  and  Dym  model  is  a 
special  case  of  a class  of  problems  for  which  the  optimal  integer  solution 
can  be  obtained  by  rounding  the  optimal  continuous  solution  appropriately. 


Problem  (5)  is  a bounded-variable  linear  programming  knapsack  problem 


uch  a problem  is  solved  by  computing  the  ratio  of  the  objective 


Briefly 


function  coefficient  to  the  constraint  coefficient  for  each  variable 


initially  set  to  its  lower  bound  and  then,  in  turn, 


Each  variable  i 


increased  to  its  upper  bound  in  order  of  decreasing  ratios  until  the 


single  functional  constraint  is  satisfied.  Thus,  the  last  variable  to 
be  changed  is  increased  only  so  far  as  possible  (i.e.,  not  necessarily 
to  its  upper  bound ) .— 

Since  each  constraint  coefficient  in  (5)  is  unity,  however,  the 


solution  procedure  reduces  to  simply  increasing  the  x 


As  discussed  in  Section  2,  the  concavity  of 


eliminates  the  need  for  introducing  the  auxiliary  variables  x 


to  determine  which  x 


explicitly.  In  comparing  the  slopes  s 


should  be  increased  next 


which  x 


not  yet  increased  to  unity.  The  concavity  of 


in  (5)  are  given  by 


Using  (2),  it  is  easy  to  show  that  the  s 


But  from  (6) 


The  algorithm  now  presented  for  the  Schwartz  and  Dym  model  (k) 


— See  Kochman  (1976)  for  a more  detailed  discussion  of  the  solution  of 
bounded-variable  linear  programming  knapsack  problems. 


It  is  assumed 


uses  (7)  rather  than  (6)  to  compute  the  coefficients 
that  M > 0,  since  otherwise  the  solution  is  trivial. 

Algorithm  1 (Schwartz  und  Dym  model). 


s 


Step  1. 


Step  2. 


Step  3- 


(initialization) 


(iterative  step) 


(Termination  test 


Set  x . = 
J 

o, 

3 = 

1,  2,  ...  , n. 

Set  s . = 
J 

v . (1-d. ), 
3 3 

j = 

1,  2,  ...  , n. 

Find  k 

such  that 

sk  = 

max  s . . 

K 

! < j < n J 

Reset  x, 
k 

= x +1. 
k 

Reset  M 

= M - 1. 

) If  M = 0,  stop.  (Current  solution  is 


optimal. ) 

Otherwise,  reset  s = d s,  and  go  to 
K K K 

Step  2. 


The  second  example  derives  from  a promotion  model  due  to  Boza  (197^) 

In  an  important  subproblem  in  Boza’s  model,  a given  candidate  population 

is  partitioned  into  n distinct  classification  pools,  with  u^  candi- 
til 

dates  in  the  j 1 pool,  j = 1,  2,  . . . , n.  In  deciding  how  many 
candidates  should  be  promoted  from  each  classification,  it  is  desired 
to  minimize  the  squared  error  between  the  achieved  classification  pro- 
portions after  promotion  and  certain  predetermined  target  proportions. 

In  addition,  at  least  l.  candidates  must  be  promoted  from  the  j^n 

J 

pool,  j = 1,  2,  ...  , n.  When  there  is  a total  of  V vacancies  to  be 


filled,  the  subproblem  becomes  the  quadratic  integer  programming  problem, 


maze 


While  (8)  is  a minimization  problem,  it  tur: . jut  that  each  a.  > 0 


n.  Thus,  (8)  is  a convex-separable  integer  program,  and 


ated  linear  program  (t)  is  again  a bounded-variable  knapsack  problem 


+ b .i . + c . ) + min 


subject  to 


or,  equivalently 


In  the  algorithm  presented  below,  the  coefficients  s 


are  computed 


It  is  assumed  that 


since  otherwise  the 


solution  is  trivial 


"■  UWMMU... 


Algorithm  2 (Boza  promotion  model). 


Step  1.  (initialization)  Set 

x . 

J 

- £J 

3 = 1, 

2, 

, n. 

Set 

c 

j 

= (2£ . +l)a  . + b ., 
3 J 3 

3 = 1» 

2,  ... 

, n. 

Set 

t . 

3 

V* 

- 2aj 

J n 

= v - 2)  V 

1 — 1 

II 

*n> 

2,  ... 

, n. 

Set 

Step  2.  (iterative  step)  Find  k such  that  s,  = min  s.. 

k Cj  | x . < u.)  J 

Reset  x,  = x.  + 1.  J ^ 

k k 

Reset  V'  = V’  - 1. 

Step  $•  (Termination  test)  If  V’  = 0,  stop.  (Current  solution  is 

optimal. ) 

Otherwise,  reset  s = s + t and  go  to 

K A K 

Step  3. 


In  determining  the  index  k in  Step  2,  only  those  j for  which  x.  < u. 

J J 

are  considered,  since  any  variable  x.  which  is  already  at  its  upper 

J 

bound  obviously  cannot  be  increased  further. 

Finally,  the  decomposition  of  block  angular  integer  programs  which 
have  only  a single  linking  constraint  is  a third  application  which  gives 
rise  to  problems  of  the  form  (S^).  This  problem  and  its  solution  pro- 
cedure are  discussed  in  detail  by  Kochman  (1976),  and  so  we  shall  not 
repeat  it  here.  However,  an  interesting  difference  from  the  models  of 

Boza  and  of  Schwartz  and  Dym  is  that,  in  this  case,  each  f.(x.), 

J J 

j = 1,  2,  ...,  n,  is  naturally  piecewise  linear.  Hence,  it  is  not 

necessary  to  introduce  the  full  set  of  (u.-i.)  zero-one  variables  x 

J J Jk 

(k  = 1,2, . . . ,u . -i . ) in  defining  the  approximating  function  g.(x.). 

3 3 3 3 
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are  characterized  by  a concave  and  separable  objective  function  subject  to  a 
set  of  linear  constraints. 

It  is  shown  how  by  suitably  modifying  the  objective  function,  the  theory  of 
spearability  in  linear  programming  can  be  applied  to  derive  efficient  solution 
procedures  for  problems  falling  in  this  class.  This  work  unifies  and  extends-.,  f 
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